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(57) Abstract: In a speech reeogniiion device 
( I ) comprising receiving means (36) lor receiving 
voice information (AJ) uttered by a speaker and 
including speech coefficient memory means (38) 
for storing a speech coefficieni indicator (SKI, 
PRI. SML WI) and including speech recognition 
means (42) which are arranged for recognizing 
text information (RTl) corresponding to the 
received voice information (AI) by evaluating 
the voice information (AJ) and the speech 
coefficient indicator (SKJ. PRI, SMI, WI). and 
including correction means (49) for correcting 
the recognized text information (RTl) and for 
producing corrected text information (CTl) and 
including adjusting means (50) for adjusting the 
stored speech coefficient indicator (SKJ. PRL 
SMI, WI) by evaluating at least the corrected 
text information (CTI), text comparing means 
(52) are provided for comparing the recognized 
text information (RTl) with the corrected text 
information (CTI) and for determining at least a 
correspondence indicator (CI) and the adjusting 
means (50) are provided for adjusting the stored 
speech cocfRCient 'indicator (SKI. PRI, SM!; WI) - 
by evaluating only one of such text parts (P2) 
of the corrected text information (CTI) whose 
correspondence indicator (CI) has a minimum 
value (MW). 
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ADAPTATION OF A SPEECH RECOGNIZER FROM CORRECTED TEXT 



The invention relates to a speech recognition device in accordance with the 
introductory part of claim 1 and also a speech recognition method in accordance with the 
introductory part of claim 6. 

Such a speech recognition device and such a speech recognition method are 
known from US 5,031,1 13. The known speech recognition device includes receiving means, 
which are formed by a microphone and an audio memory for receiving and storing a speech 
communication uttered by a speaker in a dictation. 

The known speech recognition device fiirther includes speech coefficient 
memory means in which a speech coefficient indicator is stored that is necessary for the 
execution of the speech recognition method. Such a speech coefficient indicator contains 
context information, speech model data and phoneme reference information. The context 
information contains all the words that can be recognized by the speech recognition device, 
the speech model data contains probabilities for the sequence of words of the context 
information in voice information, and the phoneme reference information contains 
information how a word portion (phoneme) is pronounced by a speaker. 

The known speech recognition device further includes speech recognition 
means which are arranged, during the execution of the speech recognition method, for 
recognizing text information that corresponds to the received voice information by evaluating 
the speech coefficient indicator stored in the speech coefficient memory means and for 
delivering this text information as recognized text information. The recognized text 
information is displayed by a monitor. 

A text processing program and a keyboard form correction means by which 
recognized text information displayed by the monitor is corrected and shown again on the-- 
monitor as corrected text information. Habitually, a user on the one hand replaces words of 
the erroneously recognized text information during the speech recognition process with the 
actually spoken words and, on the other hand, also makes other corrections. Such other 
corrections may be, for example, the insertion of a standard text portion such as, for example, 
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an address, the insenion of lexi portions forgotten during the dictation, or the substitution of 
text information entered by means of the keyboard for a text part of the recognized text 
information. 

The known speech recognition device includes adjusting means for adjusting 
the speech coefficient indicator by a better adjustment to the speaker and the language so as 
to recognize correctly from then on in a subsequent speech recognition operation words that 
had previously been recognized erroneously. For adjusting the context information and the 
speech model data, the corrected text information is evaluated and for adjusting the phoneme 
reference information, also the voice information stored in the audio memory is evaluated, to 
provide an adjusted speech coefficient indicator and store it in the speech coefficient memory 
means. 

In the known speech recognition device and with the known speech 
recognition method it has proved to be disadvantageous that corrected text information used 
for the adjustment of the speech coefficient indicator also contains text parts that do not have 
any connection at all with the voice information. When such text parts are used for adjusting 
the speech coefficient indicator, it may happen that the speech coefficient indicator, after the 
adjusmient, is not adjusted better, but worse to a speaker an J the language. 

It is an object of the invention to provide a speech recognition device and a 
speech recognition method in which only corrected text information is used for adjusting the 
speech coefficient indicator, which corrected text information has sufficient connection with 
the received voice information. This object is achieved with a speech recognition device as 
defined in the introductory part of claim I by the measures of the characterizing part of claim 
1 , and with a speech recognition method as defined in the introductory part of claim 6 by the 
measures of the characterizing part of claim 6. 

This achieves that prior to the adjustment of the speech coefficient indicator, a 
test is made whether the corrected text information contains text words which were heavily 
corrected or inserted quite new, and in that such text words are not used for adjusting the 
speech^'coefficiem indicator."^Advantageousiy, after each adjustment of the speech coefficient 
indicator, the recognition rate of the speech recognition device and of the speech recognition 
method has therefore improved considerably. 

According to the measures of claim 2 and claim 7, text words of the 
recognized text information which have sufficient connection with the received voice 
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information or recognized text information respectively, are concatenated to sequences of 
text words. The sequence of the text words of the recognized text information that has the 
largest aggregate correspondence value is used for the adjustment. This offers the advantage 
that also a text word among text words having a large correspondence indicator is used for 
the adjustment and thus the recognition rate of the speech recognition device and of the 
speech recognition method is further improved with each adjustment of the speech coefficient 
indicator. 

According to the measures of claims 3, 4 and 5, all the information contained 
in the speech coefficient indicator is adjusted very well. 



The invention will be further described in the following with reference to three 
examples of application of an example of embodiment represented in the Figures, to which, 
however, the invention is not restricted. 

Fig. 1 shows in the form of a block diagram a speech recognition device to 
which an input unit that can be held in hand and an input imit that can actuated by foot are 
connected and which includes text comparison means for comparing recognized text 
information with corrected text information, and which includes transfer means for importing 
and exporting a speech coefficient indicator. 

Fig. 2 shows the input unit that can be held in hand as shown in Fig. 1 in the 
form of a block diagram, which input xmit comprises audio processing means for processing 
an analog audio signal and for delivering digital audio data. 

Fig, 3 shows the input imit that can be actuated by foot and is shown in Fig. 1 
in the form of a block diagram, to which headphones can be connected and which includes a 
built-in loudspeaker. 

Fig. 4 shows an adjustment table established by the text comparison means of 
the speech recognition device, in which table recognized text infonmation and corrected text 
information has been entered. 



Fig. 1 shows a computer 1 by which a speech recognition program according 
to a speech recognition method is run, which computer 1 forms a dictating machine with a 
secondary speech recognition device. 
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To the computer 1 is connected a dictation microphone 2 which forms an input 
unit that can be held in hand, a foot switch 3 which forms an input unit that can be actuated 
by foot, a monitor 4 and a keyboard 5. Fig. 2 shows the dictation microphone 2 in more detail 
in the form of a block diagram. 

The dictation microphone 2 has a microphone 6 which forms audio receiving 
means and is provided for receiving a speech communication uttered by a user into the 
microphone 6 and for delivering a first analog audio signal ASl. The dictation microphone 2 
further includes audio processing means 7 which are provided for processing the first analog 
audio signal ASl and for delivering digital audio data as audio information AL 

The audio processing means 7 include a first amplifier stage 8, an analog-to- 
digital converter stage 9, a second amplifier stage 10 and a digital-to-analog converter stage 
11. The first analog audio signal ASl can be applied to the first amplifier stage 8 and the 
amplified first analog audio signal can be applied to the analog-to-digital converter stage 9. 
The analog-to-digital converter stage 9 is provided for sampling the amplified analog audio 
signal at a sample rate of 16 kHz and for delivering sampled values in digital audio data 
which have 16-bit data blocks and can be delivered as audio information AI to USB 
connecting means 12. 

This offers the advantage that the first analog audio signal ASl is digitized 
right in the dictation microphone and that the amplifier stage 8 can be adjusted to the 
maximum output voltage of the microphone 6 as early as in the manufacturing stage of the 
dictation microphone 2. In this manner, no voice information is lost due to the amplifier stage 
8 being overmodulated, so that the digital audio information AI containing the digital audio 
data has a good quality. 

Audio information AI containing a digital audio data can be delivered by the 
USB connecting means 12 to the digital-to-analog converter 11 of the audio processing 
means 7. An analog audio signal corresponding to the digital audio data can be delivered by 
the digital-to-analog converter stage 1 1 to the second amplifier stage 10. A second analog 
audio signal AS2 delivered by the second amplifier stage 10 can be applied to a loudspeaker 
13 to be reproduced acoustically. 

The dictation microphone 2" further ihclUdeS input means 1 4 for manually '^^ 
inputting control information SI, which input means include a keyboard 1 5, a track ball 16 
and input processing means 17. The keyboard 15 has, inter alia, a record key 18, a stop key 
1 9, a fast forward button 20 and a fast backward button 2 1 . The keyboard 1 5 can be 
instrumental in giving key information TSI to the input processing means 1 7. 
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The track ball 16 is formed by a ball embedded in an opening of the dictation 
microphone 2, which bail can be rotated by the user for positioning, for example, a cursor 
i displayed on the monitor 4. With the track ball 16 it is possible to feed track ball information 

TBI to the input processing means 1 7. The input processing means 1 7 are provided for 
5 processing the key information TSl and track ball information TBI delivered thereto and for 
delivering respective control information SI to the USB connecting means 12. 

The USB connecting means 12 can deliver a supply voltage U both to the 
audio processing means 7 and to tlie input means 1 4 to supply voltage to the stages contained 
in the audio processing means 7 and the input means 14. This offers the advantage that the 
1 0 dictation microphone 2 receives both information and supply voltage U fi-om the stages of the 
dictation microphone 2 via only a single cable link. 

The USB connecting means 12 are connected via a first terminal 22 of the 
dictation microphone 2 to USB connecting means 23 of the computer 1. The USB connecting 
means 12 of the dictation microphone 2 are arranged for setting up a digital data bus link and, 
15 in addition, advantageously for sening up an USB data bus link (Universal Serial Bus: 

Specification version 1 .0 on January 15 and version 2.0) to the USB connecting means 23 of 
the computer 1 . 

On a USB data bus link, error correction codes are added to the audio data of 
the audio information AI or control data of the control information SI delivered to the USB 

20 connecting means 12 or 23, and they are collectively transmitted as transmit data UD to the 
USB connecting means 23 or 12. The USB connecting means 12 or 23, by v^hich the 
transmitted data UD were received, is provided for evaluating the erroi* correction codes and 
for correcting, if necessary, errors in the audio data or the control data, which errors occurred 
during transmission. In a USB data bus link, control data of control information SI is 

25 transmitted at a data transmission rate of 1 .5 MB p.s, and audio data of audio information AI 
at a data transmission rate of 12 MB p.s. 

Fig. 3 shows in a detailed manner the foot switch 3 shown in Fig. 1 in the form 
of a block diagram. The foot switch 3 has input means 24 for manually inputting control 
information SI. The input means 24 contain an audio playback switch 25, a stop switch 26 

30 and- input processing means^ 27. Switch information SCI produced by the audio playback 

SMdtch 25 or the stop switch 26 can be delivered to the input processing means 27. The input 
processing means 27 are provided for processing the switch information SCI applied thereto 
and for applying respective control information SI to USB coimecting means 28 of the foot 
switch 3. 
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The foot switch 3 further includes audio processing means 29, which comprise 
a digitai-to-analog converter stage 30 and a third ampHfier stage 3 i. Audio information AI 
containing audio data can be appHed by the USB connecting means 2S to the digital-to- 
analog converter stage 30 which delivers to the third amplifier stage 31 an analog audio 
5 signal that corresponds to the audio data. A third analog audio signal AS3 delivered by the 
third amplifier stage 3 1 can be applied both to a loudspeaker 32 provided in the foot switch 3 
and to a second terminal 33. Headphones 34 are connected to the second terminal 33. With 
the loudspeaker 32 and the headphones 34 it is possible to have an acoustic reproduction of a 
speech communication which will be further discussed hereinafter. 

1 0 Since the audio processing means 29 are mounted in the foot switch 3, the 

advantage is obtained that the headphones 34 or a loudspeaker can be directly connected to 
the foot switch 3. As a result, the computer 1, which also forms a dictating machine, need not 
have a sound card with audio processing means. 

The USB connecting means 28 of the foot switch 3 correspond to the USB 

15 connecting means 12 and 23. The USB connecting means 28 can apply a supply voltage U 
both to the input processing means 24 and to the audio processing means 29 for powering the 
stages included in the input processing means 24 and the audio processing means 29. This 
offers the advantage that the foot switch 3 receives commimi cations as well as the supply 
voltage U over only a single cable link. 

20 The USB connecting means 28 of the fool switch 3 are connected to the USB 

connecting means 23 of the computer 1 via a third terminal 35. The computer 1 includes 
receiving means 36 which comprise the USB connecting means 23 and the audio memory 
means 37 and are arranged for receiving a sp>eech communication pronounced by a speaker. 
A speech commimication uttered by a speaker in the microphone 6 of the dictation 

25 microphone 2 can be transmitted from the USB connecting means 12 to the USB connecting 
means 23 as audio information AI constituted by digital audio data and from the USB 
connecting means 23 to the audio memory means 37 to be stored as audio information AI. 
Control information SI applied from the USB connecting means 12 of the dictation 
microphone 2 or the USB connecting means 28 of the foot switch 3 to the USB connecting 

30 means 23 of the computer 1 can bfe received by the USB connecting means 23 and deliveired 
to further means of the computer 1 which will be further discussed hereinsifter. 

The speech recognition device formed by the computer 1 includes speech 
coefficient memory means 38 provided for storing a speech coefficient indicator SKI. The 
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speech coefficient indicator SKI contains a speech model data SMI. context information WI 
and phoneme reference information PRJ. 

The context information WI is stored in context memory means 39 and 
contains all the words that can be recognized in a speech communication by the speech 
recognition device and also a word frequency meter which denotes the occurrence probability' 
of the word in a speech communication. The speech model data SMI is stored in speech 
model memory means 40 and contains word sequences as well as a word sequence frequency 
meter, which indicates the frequencies of occurrence of these word sequences in a speech 
communication. Phoneme reference information PRI is stored in phoneme reference memory 
means 41 and enables an adjustment of the speech recognition device to peculiarities of a 
speaker's pronunciation. 

The speech recognition device further includes speech recognition means 42. 
The USB connecting means 23 can deliver control information SI to the speech recognition 
means 42 for activating a speech recognition mode to implement a speech recognition 
method. With an activated speech recognition mode, the speech recognition means 42 are 
provided for reading audio information AI stored in the audio memory means 37 and for 
reading a speech coefficient indicator SKI stored in the speech coefficient memory means 38. 

During the execution of the speech recognition method the speech recognition 
means 42 are provided for evaltiating the audio information AI and the speech coefficient 
indicator SKI. The speech recognition means 42 then determine for each part of the audio 
information AI a plurality of possible word sequences which correspond to the respective 
part of the audio information AI where appropriate and produce these possible word 
sequences for all parts of the audio information AI as possible text information PTL The 
possible text information PTI contains, for example, 20 possible word sequences for the 
audio infomiation AI. Furthermore, the speech recognition means 42 - when the speech 
recognition method is executed - determine each time the most probable word sequence for 
each part of the audio information AI and produce these most probable word sequences of all 
the audio information AI as recognized text information RTI. 

The speech recognition device comprises text memory means 43 for storing 
text information. The text memory means 43 contain possible-text memory means 44, 
recognized-text memory means 45, corrected-text memory means 46 and training-text 
memory means 47. Possible text information produced by the speech recognition means 42 
during the execution of the speech recognition method can be stored in the possible-text 
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memor>' means 44 and recognized text information RTI can be stored in the recognized-text 
memor>' means 45. 

The computer I is further arranged for rxinning a text processing program 
- such as, for example. Word For Windows 95 - and forms text processing means 48. 
5 Recognized text information RTI produced by the speech recognition means 42 during the 
execution of the speech recognition method can be fed to the text processing means 48. The 
text processing means 48 are then arranged for transferring picture information PI containing 
the recognized text information RTI to the monitor 4. 

With the input means 1 4 of the dictation microphone 2 there can be input 
10 control information SI which can be applied to the speech recognition means 42 and the text 
processing means 48 and which activates a correction mode of the speech recognition device. 
The text processing means 48, the monitor 4 and the keyboard 5 here constitute correction 
means 49. When the correction mode is activated, a user can, by means of the keyboard 5, 
correct the recognized text information RTI and store corrected text information CTI in the 
1 5 corrected-text memory means 46, which will be further discussed hereinafter. 

In the training-text memory means 47 is stored training text information TTI 
which contains typical words of phrases or word sequences of a certain domain (business 
letters; field of study: radiology; field of study: law ...). Control information SI can be input 
by the input means 1 4 of the dictation microphone 2, which control information can be 
20 applied to the speech recognition means 42 and the text processing means 48 and activates an 
initial training mode of the speech recognition device. 

When the initial training mode is activated, the text processing means 47 are 
arranged for reading out the training text information TTI from the training-text memory 
means 47 and for feeding respective picture information PI to the monitor 4, A user can then 
25 utter the training text displayed on the monitor 4 into the microphone 6 to adjust the speech 
recognition device to the user's type of pronounciation. 

The speech recognition device has adjusting means 50 for adjusting the speech 
coefficient indicator SKI stored in the speech-coefficient memory means 38 to the type of 
pronounciation of the user and also to words and word sequences commonly used by the 
30 ' user. The text memory means 43," the correction means 49 and the adjusting means 50' 

together form the training means 5 1 . Such an adjustment of the speech coefficient indicator 
SKI takes place when the initial training mode is activated in which the training text 
information 1 1 1 read by the user is known. 
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Such an adjustment, however, also takes place in an adjustment mode in which 
text information corresponding to voice information is recognized as recognized text 
information RTI and is corrected by the user into corrected text information CTI. For this 
purpose, the training means 51 include text comparing means 52, which are arranged for 
5 comparing the recognized text information RTI with the corrected text information CTI and 
for determining at least a correspondence indicator CI. In the text comparing means 52 an 
adjustment table 53 shown in Fig. 4 is established when the adjustment mode is on, which 
table will be fiirther explained hereinafter. 

The result of the adjustment, which is adjustment information Nl, can be sent 
10 by the adjusting means 50 to the speech coefficient memory means 38, which adjustment 
information adjusts the stored speech coefficient indicator SKI. A training indicator TI can 
further be sent by the adjusting means 50 of the training means 5K which training indicator 
TI indicates the extent of the adjustment of the speech coefficient indicator SKI stored in the 
speech coefficient memory means 38. The U-aining indicator TI contains information about 
1 5 how often and in how many words the speech coefficient indicator SKI stored in the speech 
coefficient memory means 38 has already been adjusted to a user. The more often the speech 
coefficient indicator SKI has been adjusted to a user, the bener the recognition rate of the 
speech recognition device is for this user. 

The speech recognition device includes transfer means 54 which enable to 
20 import a speech coefficient indicator SKI and store the imported speech coefficient indicator 
SKI in the speech coefficient memory means 38 and/or export the speech coefficient 
indicator SKI stored in the speech coefficient memory means 38. For this purpose, the user 
can input transfer information TRJ by the keyboard 5 and send it to the transfer means 54, 
which will be fiirther discussed hereinafter. 
25 With reference to a first example of application, the function is further 

explained of the dictation microphone 2, the foot switch 3 and the dictating machine and 
speech recognition device formed by the computer. In accordance v^th the first example of 
application it is assumed that the user of the computer 1 would like to dictate a letter to order 
three computers of the "Quality" type with his acquaintance "John". For this purpose, the user 
30 touches the record key 1 8 of the dictation microphone 2 and dictates "Deair John I herewith 
order three Quality computers for my office Harry". Audio information AI corresponding to 
this voice information is then transmitted from the dictation microphone 2 as transmit data 
UD to the USB connecting means 23 and is finally stored in the audio memory means 37. 
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During this operation, the dictation microphone 2 and the computer 1 constitute a dictating 
machine. 

By actuating the record key 1 8 of the dictacion microphone 2, control 
information SI activating the speech recognition mode of the speech recognition means 42 is 
5 applied by the dictation microphone 2 as transmit data UD over the USB connecting means 
23 to the speech recognition means 42. In the speech recognition mode activated in the 
speech recognition means 42, the audio information AI stored in the audio memory means 37 
is read out and evaluated together with the speech coefficient indicator SKI read from the 
speech coefficient memory means 38. The speech recognition means 42 then determine a 

10 plurality of possible word sequences as possible text information PTI and store them in the 
possible-text memory means 44. For the first part of the audio information AL the possible 
text information PTI could contain, for example, the word sequences "Hear John why", "Dear 
John I" and "Bear John hi". 

The speech recognition means 42 determine the text information "Dear John I 

1 5 herewith organ three Quality computers for my office Mary" as most probable text 

information and deliver it as recognized text information RTI to the recognized-text memory 
means 45. The uttered word "order" was erroneously recognized as the word "organ" and the 
uttered word "Harry" as the word "Mary". 

The recognized text information RTI recognized by the speech recognition 

20 means 42 and stored in the recognized-text memory means 45 is then read out by the text 

processing means 48 and displayed on the monitor 4. The user recognizes that the two uttered 
words "order" and "Harry" were recognized erroneously and he/she would like to correct the 
recognized text information RTI, because of which the user activates with the input means 14 
of the dictation microphone 2 the correction mode of the speech recognition device. 

25 When the correction mode is activated, the user can, by touching the audio 

playback switch 25 of the foot switch 3, acoustically play back the audio information AI 
stored in the audio memory means 37 by means of the headphones or the loudspeaker 32, 
while the text information recognized from the audio information AI is featured on the 
monitor 4 in synchronism with the played back audio information AI. Such synchronous 

30 " editing or correction has been- known for a long time. 

In a first type of correction of the recognized text information RTI by the user, 
the user corrects only the erroneously recognized words "organ" and "Mary" into the two 
originally uttered words "order" and "Harry" and corrected text information CTI is 
constructed in the text processing means 48 and stored in the corrected-text memory means 
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46. This corrected text information CTI stored in the corrected-text memory means 46 after 
the first correction step would be highly suitable for adjusting the speech coefficient indicator 
SICI. The words "order" and "Harr>'" uttered by the user in a further dictation would be 
correctly recognized in a next speech recognition operation with the previously adjusted 
speech coefficient indicator SKJ. 

As practice shows, users also make other corrections of a second type when 
the correction mode is activated. According to the first example of application it has been 
assumed that the user now remembers that he wishes to order three computers of the 
"Standard" type, because of which the user inserts the word sequence "and three Standard 
computers" into the already corrected text information CTI by means of the keyboard 5. 
Furthermore, the user copies a text A prior to the beginning of the already corrected text 
information CTI, which text A contains the address of the letter to his acquaintance "John". 
Finally, the user copies a text B after the already corrected text information CTI in the 
corrected text information CTI, which contains a foot note about agreed discount percentage 
customary with such orders. 

The user then adds text parts to the recognized text information RTI, which 
text parts do not have any connection with the voice information uttered by the user during 
the dictation. Such text parts that must not be evaluated for adjusting the phoneme reference 
information PRJ, because no corresponding audio information AI has been stored in the audio 
memory means 37. Furthermore, it is no good adjusting the context information WI or the 
speech model data SMI with such text parts, because the text A and the text B are often 
contained in the tiser^s corrected text information CTI, but are hardly ever uttered by the user 
in dictations. 

If the context information WI and the speech model data SMI were trained 
with text parts, which do not have any connection with the voice information, for example 
the word sequence of the street name "Hell Road" contained in the text A of the address of 
the acquaintance John would have a high probability of occurrence, because the user often 
writes letters to John and always copies the address in the corrected text information CTI. A 
word sequence "Hello Rod" uttered in a dictation would, however, be easily recognized 
erroneously, because the word'sequence "Hello R6d" hi the speech model memory means 40 
would have a relatively lower probability of occurrence than the word sequence "Hell road", 
although the word sequence "Hello Rod" occurs relatively fi-equently in the user's dictations. 

After the user has made all the corrections desired by him and after the 
corrected text information CTI has been stored in the corrected-text memory means 46, the 
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user touches a key of the keyboard 15 of the dictation microphone 2 to activate the 
adjustment mode of the speech recognition device and adjust the speech coefficient indicator 
SKI of the speech recognition device. The dictation microphone 2 then applies respective 
control information SI to the speech recognition means 42 via the USB connection means 23. 

In the adjustment mode activated in the speech recognition device, the 
adjusting means 50 are arranged for reading the audio information AI stored in the audio 
memor\^ means 37, such as the possible text information PTI, recognized text information 
RTI and corrected text information CTI stored in the text memory means 43. Furthermore, 
the text comparing means 52 in the activated adjustment mode, are arranged for providing the 
adjustment table 53 shown in Fig. 4, to determine a text part of the corrected text information 
CTI that is suitable for adjusting the speech coefficient indicator SKI. 

For this purpose, first the recognized text information RTI and the corrected 
text information CTI is wrinen in the adjustment table 53. while erroneously recognized 
words as well as corrected and inserted words and text pans are represented in bold type. The 
text comparing means 52 are provided for comparing the recognized text information RTI 
and the corrected text information CTI and for featuring corresponding words by grey fields 
at the respective position of the adjustment table 53. The text part having the words "three 
computers" of the recognized text information RTI is found twice in the corrected text 
information CTI. 

Furthermore, the text comparing means 52, when comparing the recognized 
text information RTI and the corrected text information CTI, are provided for determining a 
correspondence indicator CI for each text part. The text comparing means 52 then determine 
how many matching words featured by a grey field a text part contains. Furthermore, the text 
comparing means 52 determine penalty points for each text part, vAth one penalty point being 
awarded for each insertion, deletion or substitution of a word in the corrected text 
information CTI. The correspondence indicator CI of the text part is determined from the 
nimiber of the corresponding words and penalty points of a text part. 

In the text comparing means 52 is determined a minimum value MW for the 
correspondence indicator CI, which minimum value is fallen short of when for a text part 
more than three penalty points' are awarded for corrections of adjaccntwords of'thexorrected 
text information CTI. For the adjustment of the speech coefficient indicator SKI, only text 
parts are used whose correspondence indicator CI exceeds the minimum value MW, 

The text comparing means 52 evaluate the adjustment table 53 and recognize 
that all the words of the text A and of the text B were inserted into the corrected text 
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information CTI, because of which the text comparing means 52 award to the text A and the 
text B a number of penal t>' points that corresponds to the number of words of text A and text 
B. The text comparing means 52 therefore apply a correspondence indicator CI for the text A 
and the text B to the adjusting means 50, which indicator value is smaller than the minimum 
value MW. This offers the advantage that a text part of the corrected text information CTI, 
which part has absolutely no connection with the voice information, is not used for the 
adjustment of the speech coefficient indicator SKI, 

According to the adjustment table 53, text pans which can be used for an 
adjustment of the speech coefficient indicator SKI are not dwelling on a path PI and a path 
P2 of the corrected text information CTI. 

The path PI contains a first text part "Dear John I herewith", which does not 
get any penalty points from the text comparing means 52 and whose correspondence 
indicator therefore exceeds the minimum value iMW, The path PI contains a second text part 
"order three Quality computers and" after the first text part, which second text part is 
awarded five penalty points (1) to (5) for the insertion of the words "order three Quality 
computers" and the substitution of the word "and" for the word "organ", and whose 
correspondence indicator therefore falls short of the minimum value MW. The path PI 
contains after the second text part a third text part "three Standard computers for my office 
Harry" which is awarded only one penalty point (6) for the insertion of the word "Standard" 
and whose correspondence indicator CI therefore exceeds the minimum value MW. TTie path 
P 1 therefore contains the first and the third text part which are in principle suitable for an 
adjustment of the speech coefficient indicator SKI. 

The path P2 contains a fourth text part "Dear John I herewith order three 
Quality computers", which obtains only one penalty point (1) fi-om the text comparing means 
52 for the substitution of the word "order" for the word "organ", and whose correspondence 
indicator CI therefore exceeds the minimum value MW. The path P2 contains after the fourth 
text part a fifth text part "and three Standard computers", which obtains four penalty points 
(2) to (5) for the insertion of this word and whose correspondence indicator therefore falls 
short of the minimum value MW. The path P2 contains after the fifth text part a sixth text 
part "for my office Harry", which is awarded one penalty point (6) for the substitution of the- 
word "Harry" for the word "Mary" and whose correspondence indicator CI exceeds the 
minimum value MW. The path P2 therefore contains the fourth and the sixth text parts which 
are suitable, in principle, for an adjustment of the speech coefficient indicator SKI. 
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The text comparing means 52 are provided tor determining the text pans of the 
path PI or P2 that have the largest summed correspondence indicator SCI. For this purpose, 
the text comparing means 52 determine that nine words of the path P I and ten words of the 
path P2 of the corrected text information CTI completely correspond with the words of the 
recognized text information RTI and are featured as a grey field in the adjustment table 53. 
Furthermore, the text comparing means 52 add up the penalty points of each path, where 
seven penalty points are determined for the path PI and six penalty points for the path P2. 

Finally, the text comparing means 52 determine that the text information of the 
path P2 having ten corresponding words and only six penalty points have a larger summed 
correspondence with the recognized text information RTI and supply a respectively higher 
summed correspondence indicator SCI for the text parts of the path P2 to the adjusting means 
50. 

This offers the advantage that for the adjustment of the speech coefficient 
indicator SKI words corrected according to a first type of correction - such as, for example, 
"order" and "Harry" - are used for the adjustment and text parts corrected according to the 
second type of correction - such as, for example, "and three Standard computers" that do not 
have any connection with the voice information - are not used for the adjustment. As a result, 
the speech coefficient indicator SKI is adjusted very rapidly and well to the peculiarities of 
the pronounciation of a user and typical formulation of a user, while a particularly good 
recognition rate of the speech recognition device is achieved. 

The adjusting means 50 in the adjustment mode activated in the speech 
recognition device are arranged, after the summed correspondence indicator SCI is received 
from the text comparing means 52, for reading the text parts of the path P2 of the connected 
text information CTI from the corrected-text memory means 46 and for evaluating these text 
parts. 

For adjusting the context information WI, each word of the fourth and sixth 
text parts "Dear", "John", "I", ... "Harry" of the word "order" P2 is added the value "1" in the 
frequency meter assignediy stored in the context memory means 39, where the frequency 
meter features the probability of occurrence of the respective word in a dictation of the user. 
When a word of the text part' used for the adjustment is'dictated by the user for the first time, 
it is stored in the context memory means 39 together with the value " 1" of a frequency meter. 

For adjusting the speech model data SMI stored in the speech model memory 
means 40, for example, the stored frequency meter assigned to the word sequence "I herewith 
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order" is increased by the value "1" to feature a higher probability of occurrence of such a 
formulation in a dictation of the user. 

For adjusting the phoneme reference information PRI stored in the phoneme 
reference memory means 4K only those words of the fourth and sixth text parts of the word 
sequence P2 are evaluated in combination with the associated audio information AI that fully 
correspond to a word of the recognized text information RTI and are featured in the 
adjustment table 53 by a grey field. In addition, also words of the possible text information 
PTl with the associated audio information AI can be evaluated. For this purpose, the 
adjusting means 50 check whether a word ("order", "Harry") substituted by the user with the 
first type of correction is stored for this part of the audio information AI in the possible-text 
memon^ means 44. If such a word is found in the possible-text memory means 44, also this 
word with the associated audio information AI is evaluated for adjusting the phoneme 
reference information PRI. 

Adjustable information NI containing these adjustments is then applied by the 
adjusting means 50 to the speech coefficient memory means 38 for adjusting the speech 
coefficient indicator SKI. Similarly, the adjusting means 50 apply a training indicator TI to 
the transfer means 54, which indicator features with how many words the speech coefficient 
indicator SKI already stored in the speech coefficient memory means 38 has already been 
trained. This offers the advantage that by means of the training indicator TI it is immediately 
clear whether the speech recognition device has already been adjusted well to a user and will 
thus in all probability have a good recognition rate for this user. 

According to a second example of application it is assumed that the user of the 
speech recognition device formed by the computer 1 additionally has a second computer 
which forms a second speech recognition device. The tiser would obviously like to achieve 
an equally good recognition rate on the second speech recognition device as he has already 
achieved with the speech recognition device formed by the computer I , whose speech 
recognition information SKI he has trained for several months. 

For this purpose, the user actuates a key of the keyboard 5 after which transfer 
information TRI is delivered by the keyboard 5 to the transfer means 54. The transfer means 
54 are then used for reading the speech coefficient indicator SKI stored iii the speech 
coefficient memory means 38. The transfer means 54 are further used for storing the read 
speech coefficient indicator SKI and the training indicator TI of the speech coefficient 
indicator SKI on a disk 55 inserted into a disk drive of the computer 1 . 
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This offers the advantage thai a speech coefficient indicator SKI stored in the 
speech coefficient memor>' means 38 and already trained by the user can be exported from 
the computer 1. Furthermore, the speech coefficient indicator SKI can be imported into the 
user's second computer. As a result, a user can further use a speech coefficient indicator SKI 
5 trained by him in as many other computers as he likes, which computers form a speech 
recognition device that corresponds to the speech recognition device shown in Fig. 1 , and 
obtain in this manner also with these computers a good recognition rate of the speech 
recognition device. 

Advantageously, when a speech coefficient indicator SKI is exported, the 

10 training indicator TI of the speech coefficient indicator SKI is exported along, while, when 
the speech coefficient indicator SKI is imported from the transfer means 54 there can be 
verified for the time being whether the speech coefficient indicator SKI to be imported has 
already been better trained than the speech coefficient indicator SKI stored in the speech 
coefficient memory means 38. The transfer means 54 import the speech coefficient indicator 

1 5 SKI only in the case where the test proves that the speech coefficient indicator SKI to be 
imported has already been better trained than the speech coefficient indicator SKI stored in 
the speech coefficient memory means 38. 

According to a third example of application it is assumed that the computer 1 
forms an Internet server connected to the Internet and is connected to the Internet by a fourth 

20 terminal 56. It is further assumed that the user of a further computer, which forms a dictating 
machine, has queried text information from a home page of the Internet server stored in home 
page memory means 57 of the computer 1, and that this text information was delivered to the 
further computers via the fourth terminal 56. This text information from the home page 
contains link information with which further text information stored in the home page 

25 memory means 57 can be queried, as this is generally done. The speech recognition device of 
the Internet server shown in Fig. 1 enables the user of the further computer to activate link 
information shown on the home page by voice information fed by the further computer. 

According to the third example of application it is further assumed that the 
user would like to activate the link information "hotels" shown on the home page. For this 

30 purpose, the user actuaites a record key of a dictation microphone of the further computer and 
pronounces the voice information "hotel" into the microphone of the dictation microphone. 
Audio information AI contained in this voice information is applied to the computer 1 via the 
fourth terminal 56 and the audio information AI is stored in the audio memory means 37. In 
the speech recognition mode of the speech recognition device of the computer 1 activated by 
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this voice information, the word "hotels" is recognized as recognized text information RTI by 
the speech recognition means 42, and the text information assigned to this link infomiation is 
carried from the home page memory means 57 via the fourth terminal 56 to the user's further 
computer. 

Before the speech recognition mode is activated, the speech coefficient 
indicator SKI exported by the further computer and applied to the fourth terminal 56 via the 
Internet is now advantageously imported in the computer 1 by the transfer means 54. As a 
result, the Internet server formed by the computer 1 is adjusted to the respective user, which 
is why an extremely high recognition rate is achieved. 

It may be observed diat the speech coefficient indicator SKI of a user can be 
co-transmitted with each audio information AI transmitted to the Internet server. However, it 
is particularly advantageous to transmit to the Internet server the speech coefficient indicator 
SKI of a user only the first time the home page of the Internet server is queried, and to store 
the speech coefficient indicator SKI in the Internet server for this lisen With each further 
reception of audio information AI from the further computer of this user, the Internet server 
can use the already stored speech coefficient indicator SKI for the speech recognition. 

It may be observed that the adjustment mode for adjusting the speech 
coefficient indicator SKI can also be activated automatically after corrected text information 
CTl has been stored, or by the user via a key of the keyboard 5 of the computer 1 . 

It may be observed that there are also other possibilities of determining a 
correspondence value of a text part or a simimed correspondence value of text parts of a path 
than the possibilities described with reference to the example of embodiment. Furthermore, 
the conclusion that the minimtxm value MW is fallen short of when three consecutive penalty 
points are awarded is only to be tmderstood as an example. Similarly, a number of penalty 
points exceeding a certain number of penalty points in a certain number of words of a text 
part could also be defined as a falling short of the minimum value MW. 

It may be observed that for adjusting the speech coefficient indicator SKJ it 
may also be advantageous to use only certain sections of a text part which is in principle 
suitable for adjusting the speech coefficient indicator SKI, the determination of which text 
part being explained with reference to the first example of embodiment foradjusting the • 
speech coefficient indicator SKI. For example, only words are tised to which a penalty point 
was awarded by the text comparing means 52 and words featured in the adjustment table 53 
by a grey field adjacent these words. 
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This offers the advantage that words ("order", "Harr>'") recognized wrongly 
during the speech recognition operation and corrected (substituted) by the user, and words 
' adjacent these words are used for the adjustment. Sections of the corrected text information 

CTI of text parts in principle suitable for the adjustment, which fully correspond to the 
5 recognized text information RTL are not used here for the adjustment, because these sections 
may not have been corrected by the user at all. 

It may be observed that input means of a handheld input device may also be 
arranged for applying control information to a computer, to call the computer up from a 
power-save mode to an active mode. 
10 It may be observed that also a foot-operated input device may be used in 

general for activating operating modes in the computer. The computer could form a television 
receiver and a television channel could be selected by the fool switch, on which channel a 
television broadcast is received which is displayed by the monitor. 

It may be observed that also a microphone or a loudspeaker, to which USB 
1 5 connecting means of the input device can be connected, can be connected to a foot-operated 
input device, when the microphone or the loudspeaker also has USB connecting means. In 
this case it is not necessary for the foot-operated input device to comprise audio processing 
means, because, for delivering an analog audio signal, audio processing means are then 
arranged in the microphone and the loudspeaker. 
20 It may be observed that a digital data bus link can also be formed by a radio 

frequency radio link such as, for example, in accordance with the Bluetooth Specification 
(Bluetooth Special Interest Group, May 1998). This offers the advantage that no cable link is 
necessary any longer between the input device and a computer. 

It may be observed that also a loudspeaker can be connected to the second 
25 terminal 33 of the foot switch 3. 
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CLAIMS: 



I . A speech recognition device ( 1 ) comprising 

receiving means (36) for receiving voice information (AI) uttered by a speaker 

and 

speech coefficient memory means (38) for storing a speech coefficient 
5 indicator (SKI, PRI, SMI, WI) and 

speech recognition means (42) which are provided for recognizing text 
information (RTI) corresponding to the received voice information (AI) by an evaluation of 
the voice information (AI) and the speech coefficient indicator (SKI, PRI, SMI, WI), and 

correction means (49) for correcting the recognized text information (RTI) and 
10 for producing corrected text information (CTI) and 

adjusting means (50) for adjusting the stored speech coefficient indicator (SKI, 
PRI, SMI, WI) by evaluation of at least the corrected text information, 
characterized in that 

text comparing means (42) for comparing the recognized text information 
15 (RTI) with the corrected text information (CTI) and for defining at least one correspondence 
indicator (CI) are provided and 

in that the adjusting means (50) are provided for adjusting the stored speech 
coefficient indicator (SKI, PRI, SMI, WI) by evaluating only one of such text parts (P2) of 
the corrected text information (CTI) whose correspondence indicator (CI) has a minimum 
20 value (MW). 

2. A speech recognition device (1) as claimed in claim 1, characterized in that the 

text comparing means (52) are provided for determining a sequence of text parts (P2) of the 
corrected text information whose evaluated correspondence indicators have the largest 
25 summed correspondence indicator (SCI) and in that the adjusting means (50) are provided for 
adjusting the stored speech coefficient indicator (SKI, PRI, SMI, WI) by evaluating at least 
the determined sequence of text parts (P2) of the corrected text information (RTI). 
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3. A speech recognition device (1) as claimed in claim L characterized in that a 
speech model data (SMI) can be stored as a speech coefficient indicator (SKI) in the speech 
coefficient memory' means (38, 40), which speech coefficient indicator indicates a probability 
of at least a second word succeeding a first word in voice information (AI). 

5 

4. A speech recognition device (1) as claimed in claim 1, characterized in that 
context information (WI) can be stored as a speech coefficient indicator (SKJ) in the speech 
coefficient memory means (38, 39), which speech coefficient indicator (SKI) contains all the 
words that can be recognized in voice information (AI) by the speech recognition means (42). 

10 

5. A speech recognition device (1) as claimed in claim I , characterized in that 
phoneme reference information (PRJ) can be stored as a speech coefficient indicator (SKI) in 
the speech coefficient memory means (38, 41), which speech coefficient indicator (SKI) 
makes an adjustment possible of the speech recognition means (42) to peculiarities of a 

1 5 speaker's pronunciation. 

6- A speech recognition method of recognizing text information (RTI) 

corresponding to voice information (AI), the method comprising the following steps: 
receiving voice information (AI) 
20 evaluating the received voice information (AI) and a stored speech coefficient 

indicator (SKI, PRI, SMI, WI) and producing recognized text information (RTI), 

correcting the recognized text information (RTI) and producing corrected text 
information (CTI) 

adjusting the stored speech coefficient indicator (SKJ, PRI, SMI, WI) by 
25 evaluating at least the corrected text information (CTI), 
characterized in that 

the recognized text information (RTI) is compared with the corrected text 
information (CTI) and a correspondence indicator (CI) is determined 

and in that for adjusting the stored speech coefficient indicator (SKI, PRI, 
30 ' SMI, WI) only a single text part (P2) of the corrected text information (CTI) is used whose 
correspondence indicator (CI) has a minimum value (MW). 

7. A speech recognition method as claimed in claim 6, characterized in that a 

sequence of text parts (P2) of the corrected text information (CTI) is determined whose 
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correspondence indicators have the largest summed correspondence indicator (SCI) and ii 
that for adjusting the stored speech coefficient indicator (SKI, PRJ, SMI, WI) at least the 
determined sequence of text parts (P2) of the corrected text information (CTI) is used. 
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